Europaisches Patentamt 

® /)]]J European Patent Office ® Publication number: 0 357 385 

Office europeen dee breveta A2 



EUROPEAN PATENT APPLICATION 



® Application number: 89308746.0 © Int. CI. 5 : H 04 N 1/46 

@ Date of filing: 30.08.89 



@ Priority: 31.08.88 JP 216928/88 
31.08.88 JP 216938/88 

© Date of publication of application : 
07.03.90 Bulletin 90/10 

@ Designated Contracting States: DE FR GB 



© Applicant: CANON KABUSHIKI KAISHA 
30-2, 3-chome t Shimomaruko 
Ohta-ku Tokyo (JP) 

@ Inventor: Katsuma, Makoto 
11-12 Saiwal-cho 3-chome 
Kawaguchi-shl Saltama-ken (JP) 

@ Representative: Beresford, Keith Denis Lewis et al 
BERESFORD & Co. 2-5 Warwick Court High Holborn 
London WC1R5DJ (GB) 



CO 
CO 

IS 

CO 



© Image processing method and apparatus. 

@ An image processing method and apparatus are disclosed, 
wherein differences between maximum and minimum vajues for 
predetermined pixel data of a color image to be processed, for 
three dimensional pixel data, are calculated, the calculated 
results for predetermined pixel data are operated, a color 
correction masking coefficient Is determined In accordance 
with the operation result, and if necessary, the Image is judged 
If it requires color masking correction and thereafter the color 
correction masking coefficient is determined. 
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Description 

Image Processing Method and Apparatus 



BACKGROUND OF THE INVENTION 

5 

Field of the Invention 

The present invention relates to an Image processing method and apparatus particularly for color image 
processing. 

10 Related Background Art 

In a color image input/output system such as a color scanner and laser color printer, a density signal for 
each color read from a color original by using a reader (e.g., color scanner) is subjected to gradation 
processing and thereafter, supplied to an image output device (e.g., laser color printer). In most cases, the 
density signal is corrected by using a gradation conversion table so as to obtain a final output image having a 

15 visually proper or faborable quality (final output image is an image directly outputted from a laser color printer, 
or a print obtained from a dot matrix of a color scanner). 

Specifically, In a color print system using a color scanner, a scanner head is manually set at a particular point 
on a scanner drum to check the final dot percent for each color (e.g., yellow, cyan, magenta) . If it is determined 
that a desired final dot percent cannot be obtained, the values in a gradation conversion table are manually 

20 corrected upon actuation of an adjusting knob. Alternatively, in a system using a layout scanner, an original is 
displayed on a graphics display to designate the particular point with a light pen, joy stick or the like and to 
correct the gradation table in the similar manner as above. 

As a method of automatically correcting the gradation table, there is known a method whereby an average 
value for each color R (red), G (Green), B(BIue), or Y(Yellow), M(magenta), C(Cyan) of image data is obtained 

25 to give a bias to the Image data (i.e., to perform a parallel displacement of the gradation table). There is also 
known a method whereby the gradation table is corrected such that the highlight point (with lowest density 
value or with pixels smaller than a predetermined number) and shadow point (with highest density value or with 
pixels larger than a predetermined value) of image data take the maximum and minimum value (255 and 0 for 8 
bit digital data, respectively). 

30 According to the above conventional methods, the gamma conversion is carried out for each image plane of 
R, G and B (or Y, M and C) by using the gradation table to thereby obtain a visually fine or favorable Image 
quality. These methods therefore do not consider an automatic correction of color hue. In other words, an 
automatic masking process Is not carried out. 

35 SUMMARY OF THE INVENTION 

It is therefore an object of the present Invention to provide an image processing method and apparatus 
capable of obtaining an Image with visually faborable quality. 

It is another object of the present Invention to provide an image processing method and apparatus capable 
of reproducing faborable color. 
40 It is a further object of the present invention to provide an image processing method and apparatus capable 
of reproducing a fade-out image as an image without fading. 

According to a preferred embodiment of this invention aiming at solving the above problems, there is 
disclosed an image processing apparatus wherein differences between the maximum and minimum values of 
predetermined pixel data of an image to be processed, for three dimensional pixel data, are obtained, the 
45 obtained results for the desired pixel data are calculated, and a color correction masking coefficient is 
determined In accordance with the calculated result. 

it is a still further object of the present invention to provide an Image processing method and apparatus 
capable of determining if an image to be processed is needed to be subjected to color masking correction. 
The above and other objects, and advantages of the present invention will become apparent from the 
50 following description of preferred embodiments when read in connection with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the outline of a first embodiment of an image processing apparatus 
55 capable of reproducing a visually favorable color. 

Fig. 2 is a diagram showing the image memories shown in Fig. 1 and the calculation method for image 
memory data. 

Fig. 3 is a flow chart illustrating the operation of the embodiment shown in Fig. 1 . 
Fig. 4 shows the data structure of a masking coefficient table in the parameter memory shown in Fig. 1 . 
60 R 9- 5 is a block diagram showing the outline of a second embodiment of the image processing 

apparatus. 

Fig. 6 Is a flow chart illustrating the operation of the second embodiment shown in Fig. 5. 
Fig. 7 shows the data structure of the parameter memory shown in Fig. 5. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Prior to describing the embodiments of the present invention, the results of experiments constituting the 
background art of this invention will be first described. According to the Evans theory, the integrated value for 
each R t G, B data of an ordinary color Image statistically takes substantially a constant level. This statistical fact 5 
is applied to the above-described gamma conversion. The inventor considered if this statistical tendency is 
present also for color balance. According to the experiments aiming at quantitatively determining the 
faborable visual sense of image, the following facts were found. 

If an average value of differences between maximum and minimum values of pixel data within an R, Q and B 
digital color image for each R, G and B data, falls within a certain range, the image is visually sensed faborably. 10 
If the average value is larger than the upper limit of the range, the color hue of the Image is sensed flashily, 
whereas if the average value is smaller than the lower limit of the range, the image is sensed as a whole as 
being faded out. 

In the experiments, a photograph was used as an input color Image, the density at each pixel of the image 
within the density range of 0 to 2.0 was A/D converted into 8 bit data, and the average value was calculated. 15 
According to the experiments, the average value count about 30 to 40 indicated that the image was visually 
sensed faborably. Images regarded as faborable even if they have the count in excess of this range, are 
particular images such as spot-lighted scenes at concert, poster images mainly composed of characters and 
illustrations, and the like. This invention alms at making visually faborable, not such particular images but 
ordinary images such as general scenes gathering picture, portraits and the like. The average value count 30 to 20 
40 is specific to the characteristics of the equipments used in the experiments, such as spectrum filter 
characteristics and sensitivity characteristics of the input device, and coloring characteristics of the output 
device. Therefore, the invention Is not limited to such average value count, but the value count is dependent 
upon the apparatus to be used. 

According to the preferred embodiments to be described later, there is disclosed an apparatus for 25 
automatically performing a masking process, which apparatus comprises means for calculating a difference 
between maximum and minimum values for each pixel data for three dimensional different image data such as 
R, G and B data, means for obtaining an average value of the calculated differences; masking process means 
for mask-processing an image by using an optional coefficient; and means forjudging if the average value is 
within a predetermined range. The Invention is applicable to various image processing apparatus while 30 
reproducing a visually faborable image. Such image processing apparatus Include color image Input/output 
means such as laser color copying machines, print layout systems, Image editing apparatus, image data 
retrieving apparatus, and the like. 

The preferred embodiments of the present invention will be described in detail with reference to the 
accompanying drawings. 35 

Fig. 1 is a block diagram showing the outline of the first embodiment of the image processing apparatus 
according to the present invention. With this apparatus, an Image read with a CCD scanner is processed to 
obtain a faborable reproduced color which is outputted to a color laser printer. 

Referring to Fig. 1 , a control processor (CPU) 1 controls the entirety of the apparatus. A program memory 2 
stores therein control programs for CPU 1 and various data. A parameter controller 3 controls a processing 40 
unit 5, parameter memory 4, and parameter setting I/O 6 upon an instruction from CPU 1 , to thereby perform 
parameter initialization, setting, comparison and the like necessary for the control to be described later. The 
parameter setting I/O 6 is connected to a keyboard 20 from which various commands and instructions are 
inputted, and connected to a CRT 22 for the display of inputted data. 

A processor 8 and CPU 1 are interconnected via a CPU bus 24 and an image controller 7. The processor 8 45 
which is the main device in an image processing unit 23, receives image data from one of image memories 1 1 
and 12 selected upon an instruction from CPU 1, or from an Image data I/O 15, and processes the received 
data. The processes executed by the Image controller 7 include: four fundamental arithmetic operations, 
logical operation, max/min operation, respectively for each image memory plane and for arbitrary constants; 
calculation of a difference between maximum and minimum values for each pixel of R, G and B image data; and 50 
conversion of R, G and B image data into other three-dimensional coordinate systems such as HLS or YIQ 
coordinate system. The operation results by the image controller 7 are returned to the selected one of the 
image memories 11 and 12. 

A masking process means 9 performs a masking process (of obtaining one pixel data from three pixel data 
at three planes, by using four fundamental arithmetic operations) by using a coefficient a set for three R, G and 55 
B planes of the selected image memory 11,12. The calculated results are written In the selected one of the 
image memory 11, 12 at an arbitrary plane thereof. This operation will be described more in particular with 
reference to Fig. 2. 

Fig. 2 shows the detailed structure of the image memory 12. In this embodiment, the size of one screen 
frame is 512 x 512 pixels. The image memory is constructed of three planes which are allocated to R, G and B. 60 
Each pixel data R (I, )), G(l, j), B(i, ]) are quantized In units of 8 bits (0 to 255). Each R, G, B plane shown in Fig. 2 
is processed by using a coefficient a set at masking process means 9, and the processed results are 
outputted as expressed in the following equations: 
R' (i, j) = (10 + 2*a) # R (I, J) - 

a*G (i, j)-a*B (I, j) 65 
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G' (i, J) = - a*R (l, ]) + 
(1.0 + 2*a )*G (i, j) - 
a'B (I, j) 

B' (i, j) = -a*R (i, j) - 
5 a*G (i, |) + (1.0 + 2*a)*B(i,j) 
where 1<=i, j<-512 

A cumulative counter 10 counts the sum of pixel data values of a selected plane of the Image memories 1 1 
and 12. For example, ZR(i, j) Is counted for the R plane shown in Fig. 2. An average value IR(i, j)/N (N is the 
total number of pixels) is then calculated. 

10 Fig. 4 shows a table for storing masking coefficients a to be set at masking process means 9. The 
coefficients a take different values depending upon the dynamic range of an Input device and upon the HEIKIN 
(average) value to be described later. The dynamic range differs for each column in the table, and the HEIKIN 
value differs for each row in the table. Namely, the dynamic range NOUDO 0 (density) is for a density of 0 to 2.0, 
NOUD0 1 for 0 to 2.5, and NOUDO 2 for 0 to 3.0. The coefficient values a shown in the table of Fig. 4 are stored 

15 in actual by using coded data. The table is included In the parameter memory shown in Fig. 2. 

The image data I/O 15 is an interface for the input/output of Image data, and is connected to the image 
input/output devices including in this embodiment a CCD color scanner 18 and color laser printer 19 which are 
selectively used upon an instruction from CPU 1 . The color laser printer 19 Itself has a masking process circuit 
for correcting the coloring characteristics of inputted digital color data. 

20 The image memories 1 1 and 12 each are constructed of three channel frames (e.g., R, G and B or H, L and 
S). The image memories 11 and 12 are connected to both CPU bus 24 and video bus 25 so that CPU 1 can 
access both the image memories 11 and 12. Also, the image data in either of the memories can be processed 
by the processor 8. 

The image memories 11 and 12 are connected via the video bus 25 to look-up tables 13 and 14 of high speed 
25 RAMs. respectively. Each look-up table has an address space of 256 x 8 bits. Eight address lines of the look-up 
table is directly connected to an 8 bit (256 tonal levels) output of the corresponding image memory. The output 
data lines of the look-up table are connected to the video bus 25. CPU 1 can freely read/write image data 
from/into the look-up tables 13 and 14 via the image controller 7 and processor 8. 
A graphic controller 16 controls a graphics CRT 17 to display image data. The graphic controller 16 selects 
30 one of the image memories 1 1 and 12 in accordance with an instruction from CPU 1 , and converts the digital 
image signal outputted from the corresponding look-up table 13, 14 into an analog video signal to display It on 
the graphics CRT 17. 

CRT 22 is used for notifying an operator of an instruction by displaying on it the set parameter or a parameter 
setting request. 

35 

Description of Process Operation 

Fig. 3 is a flow chart illustrating the operation of the embodiment which allows faborable color reproduction, 
and Fig. 4 shows as described previously the contents of the parameter memory 4. The operation of the image 
processing apparatus constructed as above will be described with reference to the flow chart shown in Fig. 3. 

40 At step S1 t CPU 1 sets the image data I/O 15 at an input device selection mode, and the conditions of the 
image input device for inputting original image data, in this case, the conditions of the CCD scanner 18, are 
inputted. This input operation is carried out by displaying the dynamic ranges for the CCD scanner 18 on CRT 
22 and notifying an operator of a request to input any one of the displayed dynamic ranges. The inputted 
dynamic range determines the range of the original image density to be used in processing the original image. 

45 The original image data within the determined range are expressed by 8 bit data having 1 to 255 tonal levels. In 
this embodiment, the three dynamic ranges of 0 to 2.0, 0 to 2.5, and 0 to 3.0 are used as described previously. 
An operator selects one of the dynamic ranges, which is stored as one of the values of NOUDO 0. 1 , and 2 in 
the parameter memory 4. 

Upon setting the input conditions of image data, CPU 1 causes the processor 8 to notify, via the image data 
50 I/0 15, the CCD scanner 18 of the set conditions, in accordance with the notified conditions, the CCD scanner 
18 reads the original Image data and stores respective R, G and B components thereof in the Image memory 
11. 

At step S2, the maximum values of pixel data for respective pixel points of three planes (R, G, B) are 
obtained. First, the pixel data at R or a plane of the Image memory 11 are compared with the pixel data at G 

55 plane or b plane under control of the processor 8. The larger value thereof is stored in the image memory 1 2 at 
a plane. Next, the pixel data at a plane of the image memory 1 2 are compared with the pixel data at B plane or c 
plane of the image memory 1 1 under control of the processor 8. The larger value thereof is stored in the image 
memory 12 at b, the value stored in the image memory 12 at b plane being the maximum value of pixel data for 
one pixel point. The maximum values for all pixels are stored in the above manner. 

60 At step S3, the minimum values of pixel data for respective pixel points of three planes (R, G, B) are 
obtained. First, the pixel data at R or a plane of the image memory 11 are compared with the pixel data at G 
plane or b plane under control of the processor 8. The smaller value thereof is stored in the image memory 1 2 
at a plane. Next, the pixel data at a plane of the Image memory 12 are compared with the pixel data at B plane or 
c plane of the image memory 11~ under control of the processor 8. The larger value thereof is stored in the 

65 image memory 12 at c, the value stored in the image memory 12 at c plane being the minimum value of pixel 
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data for one pixel point. The maximum values for all pixels are stored In the above manner. 

At step S4, based upon the pixel data stored at step S2 in the image memory at b plane and the pixel data 
stored at step S3 in the image memory at c plane, a difference therebetween Is obtained for each pixel point 
through calculation by the processor 8. The results are written in the image memory 12 at a plane. 

At step S5, an average value of pixel data in the image memory 12 at a plane is calculated and stored as the 5 
variable HEIKIN. The more detailed operation at step S5 will be given below, upon reception of an instruction 
from CPU 1 via the image controller 7, the cumulative counter 10 counts the sum of pixel data in the image 
memory 12 at a plane, to thus obtain 2 X(i, j), wherein X(i, j) represents 8 bit data, i, and j are an integer from 1 
to 512. The sum is then divided by the total number N (512 * 512) of pixels to obtain an average value (variable 
HEIKIN). The decimal of the average vaJue HEIKIN is cut off to obtain an integer variable which takes one of 0 to 10 
255. 

At step S6 t in accordance with the obtained variable HEIKIN and the set value NOUDO of the dynamic range 
of the input device, the masking coefficient a is read from the data table (Fig. 4) in the parameter memory 4, 
and set at masking process means 9. Specifically, CPU 1 generates an address of the data table in the 
parameter memory 4 to access the masking coefficient corresponding to the variable HEIKIN and NOUDO 15 
value. The read-out masking coefficient Is set at masking process means 9 by means of the parameter 
controller 3 and image controller 7. For example, for the variable HEIKIN of 18 and the dynamic range set value 
NOUDO of 0 (range from 0 to 2.0), the masking coefficient a of 0.28 fs read and set at masking process means 
9. 

At step S7, masking process is performed by masking process means 9. First, image data are read from the 20 
image memory 11 at R, G and B planes to execute the following processes. First, the following calculation is 
carried out and the results are stored in the image memory 12 at a plane: 
(1.0 + 2*a)*R(i,j)-a*Q(ij)-a*B(l f j) 

Next, the following calculation is carried out and the results are stored in the image memory 12 at b plane. 
-a'ROJ) + (10 + 2*a)*G(l,J)-a*B(i,j) 25 
Lastly, the following calculation is carried out and the results are stored in the Image memory 12 at c plane. 
Variables i t and j take a value from 1 to 512. 
-a*R(!,j)-a*G(i,j) + (1.0 + 2*aKB(ij) 

In the above calculations, If the operation result is an over-flow (in excess of 255), then a value 255 is used, 
whereas if it is an under-fiow (negative value), then a value 0 is used. 30 

At step S8, the image data I/O 15 is switched from the input device selection mode to an output device 
selection mode, and the processed image data are outputted to the color laser printer via the image data I/O 
15. Specifically, the data in the image memory 12 are transferred via the image data I/O 15 to the color laser 
printer 19 under control of CPU 1. After data transfer, an instruction to output an image is sent to the color 
printer 19, to complete the image data output. 35 

In the above embodiment, obtaining an average value, generating an address, and setting a parameter are 
carried out In accordance with software sequence using a microcomputer. It is obvious however that a 
dedicated hardware may be used instead to obtain the same advantages of this Invention. Further, In the above 
embodiment, only the masking process has been described in performing a faborable image reproduction. It is 
obvious however that a conventional technology of gamma conversion may well by used in combination with 40 
the masking process. 

Other Embodiment 

Various modifications which use the following methods may be made in place of the above embodiment 
wherein the masking coefficient is obtained by using the dynamic range of an input device and the average 45 
value of differences between maximum and minimum values for three R, G and B planes. 
(1 ) The masking process is carried out by using the following matrix: 




50 



where aij , l<i r j£3 

wherein there are provided memory tables the contents of which are identified by the dynamic range of an 
input device and the average value of differences for each of three R, G and B planes. According to this 
method, although a masking coefficient differs more or less depending upon each plane, a masking 60 
coefficient specific to a particular plane can be selected. In addition, the calculation such as (1.0 + 2 * a), 
(1.0 - a) in the above embodiment Is not necessary. 

(2) Instead of preparing all the masking coefficients for the average values 0 to 255, representative 
coefficients only are stored in the memory table. A coefficient for each average value is obtained through 
interpolation, and set at masking process means. For example, instead of preparing all the masking 65 



5 



5/8/06, EAST Version: 2.0.3.0 



EP 0 357 385 A2 



coefficients for the average values 0 to 255 as shown in Fig. 4, masking coefficients for every tenths of 
average values may be stored in the memory table. The coefficient for an intermediate average value is 
obtained through interpolation. 
(3) In the previous embodiment, a masking coefficient table is prepared due to a difference of dynamic 
5 range of an input apparatus, and a coefficient is selected on the basis of both average value and a value 

indicative of a dynamic range. However, according to the following method a masking coefficient may be 
selected by using a memory table including variables of average values only. Namely, an average value of 
data of a difference between maximum and minimum values for each image pixel in a previous 
embodiment is divided by density value (2.0, 2.5 and 3.0) of dynamic range. Then, on the basis of an 
10 integer proportional to the value obtained by the division, a masking coefficient is selected with reference 

to a memory table. In this case, as a matter of course, the memory table corresponds to a table including 
values obtained by dividing average count values by density value. 
In the above embodiment, as the data at different three dimensional planes of a color image, R, Q and B data 
are used. The invention is not limited thereto, but other data such as Y, M and C data, Y, I and Q data, H, L and S 
15 data may also be used. 

As appreciated from the description of the above embodiment, an operator is not required to designate a 
particular masking coefficient, but the coefficient Is automatically determined in accordance with the image 
quality to thus allow a visually faborable image output. 
Further, the problem of emphasizing the color hue of a negative film more than necessary when outputting it 
20 as a positive film can be readily solved. In addition, a fade-out original Image can be automatically corrected. 
As described so far, according to the image processing method of thid embodiment, it is possible to 
reproduce an image visually faborabiy. 

Next, the second embodiment of the present invention will be described. With this embodiment, the quality 
of an Image to be processed is checked as to whether the quality is required to be corrected. If correction is 
25 necessary, the masking coefficient is corrected to obtain a faborable image. 

The structure of the apparatus of the second embodiment is shown in Fig. 5 wherein components having 
similar functions to those shown in Fig. 1 are represented by using identical reference numerals, and the 
description therefor is omitted. 
In this embodiment shown in Fig. 5, different from the embodiment shown In Fig. 1 , in addition to the image 
30 memories 1 1 and 12, there are provided an image memory 1 13 and look-up table 116. The image memory 1 1 is 
used for storing original image data, image memory 12 for storing image data after masking processing, and 
image memory 113 for a work memory during calculation. 

Masking process means 9 performs a masking process (of obtaining one pixel data from three pixel data at 
three planes through four fundamental arithmetic calculations) by using a coefficient a set for three R, G and B 
35 planes and stored in the image memory 11. The result is written in the image memory 12 at a particular plane 
thereof. 

The structure of the image memories 11, 12 and 113 is the same as shown in Fig. 2. The look-up table 116 
has the same structure as that of the look-up table 14, 15. 

Fig. 7 shows the contents of a data table stored In the parameter memory 4, the table storing parameters 
40 used for incrementing or decrementing the masking coefficient a to be set at masking processing means 9. 
The coefficient changes with the dynamic range set for an input device. 

Specifically, AaO stands for the inputted dynamic range of 0 to 2.0, Aa1 for that of 0 to 2.5, and Aa2 for that 
of 0 to 3.0. Namely, the address of the contents to be accessed in the table changes with the dynamic range of 
an input device. 

45 

Description of Process Operation 

Fig. 6 Is a flow chart showing the operation of reproducing a faborable color according to the second 
embodiment of this invention. 
The operation of the image processing apparatus constructed as above will be described with reference to 
50 the flow chart shown in Fig. 6. 

At step S1, CPU 1 sets the image data I/O 15 in an input device selection mode, and the conditions of the 
Image input device for inputting original image data, in this case, the conditions of the CCD scanner 18, are 
inputted. This input operation is carried out by displaying the dynamic ranges for the CCD scanner 18 on CRT 
22 and notifying an operator of a request to input any one of the displayed dynamic ranges. The inputted 
55 dynamic range determines the range of the original image density to be used in processing the original image. 
The original image data within the determined range are expressed by 8 bit data having 0 to 255 tonal levels. In 
this embodiment, the three dynamic ranges of 0 to 2.0, 0 to 2.5, and 0 to 3.0 are used as described previously. 
An operator selects one of the dynamic ranges, which is stored as one of the values of NOUDO 0, 1, and 2 in 
the parameter memory 4. 

60 Upon setting the input conditions of image data, CPU 1 causes the processor 8 to notify, via the image data 
I/O 15, the CCD scanner 18 of the set conditions. In accordance with the notified conditions, the CCD scanner 
18 reads the original image data and stores respective R, G and B components thereon in the image memory 

At step S2, CPU 1 initializes the masking coefficient to 0. 
65 At step S3, the masking coefficient initialized at step S2 is set at masking process means 9. 
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At step S4, masking process is performed by masking process means 9. First, image data are read from the 
image memory 11 at R, G and B planes and inputted to masking processing means 9 to execute the masking 
process. After the masking process, the results are outputted to the image memory 12 whereat the following 
processes are carried out. 

First, the following calculation is carried out for the masking process at R plane, and the results are stored in 5 
the image memory 12 at a plane: 
(1.0 + 2*a)*R(ij) -a*G(ij) -a*B(i,j) 

Next, the following calculation is carried out for the masking process at G plane, and the results are stored in 
the image memory 12 at b plane. 

-a*R(i,j) + (1.0 + 2*a)*G(i,j)-a*B(I,j) 10 
Lastly, the following calculation is carried out for the masking process at B plane, and the results are stored in 
the image memory 12 at c plane. 

-a*R(i,j)-a*G(i,J) + (1.0 + 2*a)*B(iJ) occi 

In the above calculations, if the operation result Is an over-flow (in excess of 255), then a value 255 is used, 
whereas If it is an under-flow (negative value), then a value 0 is used. 15 

At step S4 after the initialization of the masking coefficient a=0, the contents 0 of the image memory 1 1 are 
simply copied into the image memory 12. 

At step S5, the maximum values of pixel data for respective pixel points of three planes (R, G, B) are 
obtained. First, the pixel data at R or a plane of the image memory 12 are compared with the pixel data at G 
plane or b plane under control of the processor 8. The large value thereof Is stored in the image memory 1 3 at a 20 
plane. Next, the pixel data at a plane of the image memory 13 are compared with the pixel data at B plane or c 
plane of the image memory 12 under control of the processor 8. The larger value thereof is stored in the image 
memory 13 at b, the value stored in the image memory 13 at b plane being the maximum value of pixel data for 
one pixel point. The maximum values for all pixels are stored in the above manner. 

At step S6, the minimum values of pixel data for respective pixel points of three planes (R, G, B) are 25 
obtained. First, the pixel data at R or a plane of the image memory 12 are compared with the pixel data at G 
plane or b plane under control of the processor 8. The smaller value thereof is stored in the image memory 13 
at a planeT Next, the pixel data at a plane of the image memory 1 3 are compared with the pixel data at B plane or 
c plane of the Image memory 12 under control of the processor 8. The larger value thereof is stored in the 
image memory 13 at c, the value stored in the Image memory 13 at c plane being the minimum value of pixel 30 
data for one pixel point. The maximum values for all pixels are stored in the above manner. 

At step S7, based upon the pixel data stored at step S5 in the image memory 13 at b plane and the pixel data 
stored at step S6 in the image memory 13 at c plane, a difference therebetween is obtained for each pixel point 
through calculation by the processor 8. The results are written in the image memory 13 at a plane. 

At step S8, an average value of pixel data in the image memory 13 at a plane is calculated and stored as the 35 
variable HEIKIN. The more detailed operation at step S8 will be given below. Upon reception of an instruction 
from CPU 1 via the Image controller 7, the cumulative counter 10 counts the sum of pixel data in the image 
memory 13 at a plane, to thus obtain X X(i, j), wherein X(i, j) represents 8 bit data, i t and j are an integer from 1 
to 512. The sum is then divided by the total number N (512 x 512) of pixels to obtain an average value (variable 
HEIKIN). The decimal of the average value HEIKIN is cut off to obtain an integer variable which takes one of 0 to 40 
255. The above operation from step S5 to step S8 are substantially the same as those steps at S2 to S5 shown 
in Fig. 3. 

Next, at step S9, the variable HEIKIN is compared with a predetermined value SETTE1 1 (set value 1) stored 
previously in the parameter memory 4. If the variable HEIKIN is larger than the value SETTEI 1, the control 
advances to step S13. The SETTEI value 1 corresponds to color characters or illustrations which are regarded 45 
as not requesting faborable color reproduction as in the case of ordinary images. Therefore, the control 
branches from step S9 to S13 to output image data without masking processing. 

At step S10, the HEIKIN is compared with a predetermined value SETTEI 2 (set value 2) stored previously in 
the parameter memory 4. If the variable HEIKIN is larger than the value SETTEI 2, the control advances to step 
S13. The value SETTEI 2 corresponds to monochrome Images or image having an extremely small color image 50 
portion which are regarded not requesting faborable color reproduction as In the case of ordinary images. 
Therefore, the control branches from step S9 to S13 to output image data without masking processing. On the 
contrary, if such an image (monochrome image) is emphasized through the masking process, the effects of 
color shift of an input device is exaggerated to thus result in a visually unfavorable image. 

At steps S1 1 and S12, it is checked if the variable HEIKIN is larger than a predetermined upper limit value 55 
SETTEI 3 or smaller than a predetermined lower limit value SETTEI 4. At step S1 1 , If the variable HEIKIN is not 
larger than the value SETTEI 3, the coefficient a is incremented to a ~ a + Act and the control returns to step 
S3. The value Act corresponding to the variable NOUDO representative of the dynamic range of the Input 
device is read from the parameter memory 4. If the variable HEIKIN in larger than the value SETTEI 3, the 
control advances to step S12 whereat the coefficient a is decremented to a = a - Act and the control returns 60 
to step S3. Also In this case, the value Aa corresponding to the variable NOUDO representative of the dynamic 
range of the input device is read from the parameter memory 4. If the variable HEIKIN is not larger than the 
value SETTEI 4, the control advances to step S13, 

At step S13, the image data I/O 15 is switched from the input device selection mode to an output device 
selection mode, and the processed image data are outputted to the color laser printer 19 via the image data 65 
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I/0 1 5. Specifically, the data in the image memory 1 2 are transferred via the image data I/0 15 to the color laser 
printer 19 under control of CPU 1. After data transfer, an instruction to output an image is sent to the color 
printer 19, to complete the image data output. 
In the above embodiment, obtaining an average value, generating an address, and setting a parameter are 

5 carried out in accordance with software sequence using a microcomputer. It is obvious however that a 
dedicated hardware may be used instead to obtain the same advantages of this Invention. In the above 
embodiment, the masking coefficient is incremented or decremented to set the average value of differences 
between maximum and minimum values of each pixel within a predetermined range. Other known operations 
on the masking coefficient may be used so long as the average value is set within the predetermined range. 

10 Further, in the above embodiment, only the masking process has been described in performing a faborable 
image reproduction. It is obvious however that a conventional technology of gamma conversion may well by 
used in combination with the masking process. In the embodiment shown in Fig. 5, one of the 
increment/decrement Aa values AaO, Aa1 and Aa2 is selected for each dynamic range of an input device. 
However, one increment/decrement value only may be used in the following manner. Specifically, in the similar 

15 manner as of the embodiment shown in Fig. 1 t valuable Aa is set to a value corresponding to a density. For 
example, an average value of data of a difference between maximum and minimum values for each image pixel 
in a previous embodiment Is divided by density value (2.0, 2.5 and 3.0) of dynamic range. Then, on the basis of 
an integer proportional to the value obtained by the division, a masking coefficient Is selected. In this case, as a 
matter of course, a value of Aa in a parameter memory is set to a value obtained by dividing average count 

20 value by density value. 

As appreciated from the description of the above embodiment, an operator Is not required to designate a 
particular masking coefficient, but the coefficient is automatically determined in accordance with the image 
quality, and if a masking correction is necessary, the coefficient is automatically corrected, to thus allow a 
visually faborable image output. 

25 Further, the problem of emphasizing the color hue of a negative film more than necessary when outputting it 
as a positive film can be readily solved. In addition, a fade-out original image can be automatically corrected. 
Furthermore, according to this embodiment, an original of color characters or monochrome images can be 
processed properly. 

As described so far, according to the image processing method of this embodiment, it is possible to 
30 reproduce an Image visually faborably. 

According to the first and second embodiments, the masking coefficient is determined based on an average 
value of differences between maximum and minimum values of all pixels within a screen image. The masking 
coefficient may also be determined in such a manner that R, G and B data for each pixel are converted into H, L 
and S (Hue, Lightness, Saturation) data, an average of S data within a screen Image is obtained, and the 
35 masking coefficient is determined so as for the S data average to have a predetermined value. 



Claims 

40 1 . An image processing method comprising: 

obtaining differences between maximum and minimum values for predetermined pixel data of an image to 
be processed, for three dimensional image data; 
calculating said differences for a plurality of pixels ; and 

color correcting said image to be processed in accordance with the result of said calculation. 
45 2. An image processing method according to claim 1 , wherein said calculation obtains an average value 

of said differences for a plurality of pixels. 

3. An image processing method according to claim 1 , wherein said three dimensional data are R, G and 
B data. 

4. An image processing method according to claim 1 , wherein said three dimensional data are Y, M and 
50 Cdata. 

5. An image processing method according to claim 1 , wherein said color correction is a color correction 
based on a color correction masking coefficient, and said color correction masking coefficient Is 
determined in accordance with the result of said calculation. 

6. An image processing method according to claim 1, wherein said predetermined pixels include all the 
55 pixels of said Image. 

7. An image processing apparatus comprising: 

means for calculating differences between maximum and minimum values for predetermined pixel data on 
an image to be processed, for three dimensional different pixel data; 
means for operating the calculation results for a predetermined number of pixel; and 
60 means for judging rf said operation results fall within a predetermined range. 

8. An image processing apparatus according to claim 7, further comprising processing means for color 
correcting the pixel data of said image to be processed. 

9. An Image processing apparatus according to claim 8, further comprising means for controlling said 
processing means in accordance with a judgement obtained by said judging means. 

65 10. An image processing apparatus according to claim 7, wherein said operation obtains an average 
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value of said differences for a plurality of pixels. 

11. An image processing apparatus according to claim 7, wherein said three dimensional data are R, G 
and B data. 

12. An image processing apparatus according to claim 7, wherein said three dimensional data are Y, M 
and C data. 

13. An image processing apparatus according to claim 8, wherein said processing means color-corrects 
in accordance with a color correction masking coefficient. 

14. An image processing method comprising: 

obtaining an average saturation of an image to be processed, within a predetermined area; 
and 

controlling color correction of said image to be processed, in accordance with said saturation. 

15. An image processing method according to claim 14, wherein said average saturation is an average of 
saturations of pixels constituting said image to be processed. 

16. An image processing method according to claim 14, wherein color correction of said image 
processed is carried out by using a color masking coefficient. 

17. An image processing method according to claim 14, wherein said control include determining if color 
correction is to be carried out or not. 

18. An image processing method according to claim 14, wherein said image to be processed is 
composed of R, G and B data, and said saturation corresponds to a difference between maximum and 
minimum values at each pixel of said R, G and B data. 

19. An image processing method, comprising: 

determining the ranges of values for predetermined plural-component pixel data of an image to be 
processed; calculating a value from the determined ranges; and colour correcting the image to be 
processed on the basis of the calculated value. 
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